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We study analytically the order statistics of a time series generated by the successive positions 
of a symmetric random walk of n steps with step lengths of finite variance . We show that 
the statistics of the gap dfc,n = Mk,n — Mk+i,n between the fc-th and the {k + l)-th maximum of 
the time series becomes stationary, i.e, independent of n as n -> oo and exhibits a rich, universal 
behavior. The mean stationary gap (in units of a) exhibits a universal algebraic decay for large k, 
{dk,oo)/cy ~ l/\/27r/c, independent of the details of the jump distribution. Moreover, the probability 
density (pdf) of the stationary gap exhibits scaling, Pr{dk^oc = 5) — {Vk / a)P(5^/~k / a) , in the 
scaling regime when 5 ~ (dfc.oo) — cr/\/27rfc. The scaling function P{x) is universal and has an 
unexpected power law tail, P{x) ~ a;^* for large x. For 5 S> (dk^oo) the scaling breaks down and the 
pdf gets cut-off in a nonuniversal way. Consequently, the moments of the gap exhibit an unusual 
multi-scaling behavior. 

PACS numbers: 02.50.-r, 05.40.-a,05.40.Fb, 02.50.Cw 



During the last fifty years, extreme value statistics 
(EVS), the statistics of the maximum or the minimum of 
a set of random variables, have found many applications, 
ranging from engineering ^ to environmental sciences [5] 
or finance [3l|4j, where rare and extreme events may have 
drastic consequences. It was demonstrated [5j that EVS 
also plays a major role in the physics of complex and 
disordered systems. Therefore finding the distribution 
of the maximum Xmax (or the minimum Xmm) of a set 
of n + 1 random variables {xq, xi,X2, - ■ ■ , Xn} has been 
the subject of intense activity not just for independent 
and identically distributed (iid) random variables jlj , but 
also recently for strongly correlated random variables [51- 
[Ti] that are often more relevant in physical contexts. 

While the statistics of the extremum Xmax (or Xmin) 
is important, they concern the fluctuations of a single 
value among a typically large sample and a natural ques- 
tion is then: are these extremal values isolated, i.e., far 
away from the others, or are there many other events 
close to them? Such questions have led to the study 
of the density of states of near-extreme events [El [17] . 
This is, for instance, a crucial question in disordered sys- 
tems, where the low temperature properties are governed 
by excited states close to the ground state. A natural 
way to characterize this phenomenon of crowding of near- 
extreme events is via the order statistics, i.e., arranging 
the random variables Xm^s in decreasing order of mag- 
nitude Mi_„ > ... > Mfc_„ > ... > Mn+i^n where Mfe^„ 
denotes the fc-th maximum of the set {xo,xi, . . . ,Xn}- 
Evidently, Xmax = Afi_„, while Xmin = Af„-i-i,n- A set 
of useful observables that are naturally sensitive to the 
crowding of extremum are the gaps between the consec- 
utive ordered maxima: dk,n — M^^n — M}~+i,n denoting 
the fc-th gap. 



While the study of order (or gap) statistics has received 
considerable interest in statistics literature, e.g., in the 
context of system reliability ^18] , the available results are 
restricted only to iid variables. In contrast, there hardly 
exist analytical results for the gap statistics for strongly 
correlated random variables. The importance of order 
statistics for such correlated variables came up recently 
in several physical contexts, notably in the study of the 
branching Brownian motion [19) and also for 1//" sig- 
nals [20] with an application to the statistical analysis of 
cosmological observations [2l]. Any solvable model for 
the order statistics for correlated variables would thus be 
welcome and this Letter takes a step in that direction. 
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FIG. 1. A realization of a random walk of n = 6 steps. We 
denote by Mk,6 the fe-th maximum and focus in particular on 
the gaps dk,n = Mk,n — Mk+i,n- Note that xq is taken into 
account in the statistics. 

In this Letter, we present exact analytical results for 
the order statistics and the gap distribution of a time se- 
ries {xo, xi, . . . , Xn} where Xm represents the position of 
a random walker at discrete time m. The walker starts 
at xq = at time and at each discrete step evolves via 
Xm — Xm-1 + ?7m, whcre the noise rjm's are iid jump 
lengths each drawn from a symmetric and continuous 
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distribution /(ry) with zero mean and a finite variance 
= J^oo •^('?) Even though the jump lengths are 
uncorrelated, the entries clearly correlated and 

represent perhaps the simplest, yet most ubiquitous cor- 
related time series (discrete-time Brownian motion) with 
a large variety of applications [351 US] , including for in- 
stance in queuing theory |24j - where Xm represents the 
length of a single server queue at time m - or in finance 
where Xm represents the logarithm of the price of a stock 
at time m [25] . Even for this relatively simple correlated 
time series, we show that the gap distribution exhibits a 
rather rich and universal behavior. 

It is useful to summarize our main results. For large n, 
one finds that (Affc.„)/tT = y^2n/'K + 0(1), independent 
of k. Thus the property of the crowding of extremum 
(/c-dependence) is not captured by the statistics of the 
maxima Mfe_„ themselves, at least to leading order for 
large n. The simplest observable that is sensitive to the 
crowding phenomenon is the gap, dk,n = Mk^n — M^+i^n 
(see Fig. [l]). Our main result is to show that the statis- 
tics of the scaled gap dk,n/(J becomes stationary, i.e., 
independent of n for large n, but retains a rich, non- 
trivial k dependence which becomes universal for large 
k, i.e. independent of the details of the jump distri- 
bution /(??). We compute the stationary mean gap 
dk = {dk.oo) exactly for all k, for arbitrary fivi) and 
show that, when expressed in units of cr, it has a uni- 
versal algebraic tail, dfc/cr « Xj^Jlixk for large k. Next, 
we compute exactly the full pdf of the stationary gap 
Pfc(^) — Pr(rffc,oo = <^) for the exponential jump distri- 
bution, /(ry) = exp (— 1?7|/6) and show that for large 
/c, there is a scaling regime when b ~ (d/c,oo) — o l\Jl'nk 
where the pdf scales as, Pfc((5) ~ {'\/k/a)P[5^/k/a), with 
a nontrivial scaling function 

P{x) = A[^{l + 2x^)^e'^\{'ix'+i)evic{V2x)\ , (1) 

where erfc(z) (2/y^) ^'^ e~* dt is the complementary 
error function. While we were unable to compute the gap 
pdf for arbitrary /(?]), our numerical simulations provide 
strong evidence that the scaling function P{x) in Eq. ([T]) 
is actually universal, i.e., independent of /(?y). Somewhat 
unexpectedly, we find that this universal scaling function 



has an algebraic tail P{x) 



for large x. For 5 ^ 



(rffc.oo) — cr/ v27rfc, the pdf gets cut-off in a nonuniversal 
fashion. This is shown to have interesting consequences 
for the moments of the stationary gap: (c?^ n) ^ 
p < 3, while (d^. ^) ~ fc~5 for p > 3. 

We start with the statistics of the k-ih maximum Mk^n 
of the random walk Xm — Xm-i +'>lm of n steps, starting 
from the initial value xq — 0. The goal is to write down 
an evolution equation for the cumulative distribution of 
the fc-th maximum i^fc_„(x) = Pr[Affc „ < x]. The event 
Mk.n ^ X means that we have at most (k—l) points above 
the level x between step 1 and n. To keep track of this 




FIG. 2. Illustration of the backward equation in Eq. (|3|. 



event, it is convenient first to define an auxiliary quantity 
Qk.ni^) denoting the probability that the random walk, 
starting at xq — x, has k points below from step I 
to step n. It is then easy to see that Fk^n{x) can be 
expressed as the sum 



Fk,n{x) 



(2) 



where we used that /(r;) is symmetric and continuous. 

The next step is to write a backward recurrence equa- 
tion for qk,n{x) by considering the stochastic jump x ^ x' 
at the first step (see Fig. [2| and then subsequently us- 
ing the Markov property of the evolution. One gets, for 



n > 1, 



qk, 



i^i{x')fix' - x)dx' 



+ / qn-k,n-l{-x')f{x' ~ x)dx' , (3) 



starting from qQ,o{x) = 1. The first term corresponds 
to a jump from a; > to x' > while the second term 
corresponds to a jump from x > to < (see Fig. [2|. 

The integral equation ([3| is of the Wiener-Hopf type 
which are generically hard to solve for arbitrary jump 
distribution f{x). However, for the special case f{x) — 
^exp(— |x|/6) (with h = a/-\/2), using the useful prop- 
erty, f"{x) = b'^f{x) — b'^S{x), we were able to reduce this 
integral equation into a differential recurrence equation 
which can subsequently be solved by generating function 
method. Skipping details [29], we get 



q{z,s,x) 



oo n ^ 

^^s"z'=gfe,„(x) - — 



(4) 



71=0 k=0 
1 



v/(l-.s)(l-z.s) 



1 - s 



exp 



(7/ 



from which, using Eq. ([2]), the p-th moment of the k- 
th maximum (M^ f,) can be extracted. In particular for 
p = 1 we get [55] 
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It follows from ([H]) that for large n, {Mk,n)/<7 ~ ■\/2 ti/tt, 
independently of fc, while the average gap (dk^n) is given 
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by 



(4,„> _ /r(fc + i) r(n-fc + |) 



2Trk\ 



/27r(n - fc + 1)! 



Note that {dk.n) — {dn-k+i.n) reflecting the up-down 
(max-min) symmetry of the walk. Interestingly, as 
n — ^ cx), (dk^n) approaches a finite value 



lim 

n— >-C30 



{dk 



r(fc 



no point in the interval [— A, 0]. The joint distribution 
Sk.n{x, y) can be expressed in terms of Q as 

(6) ( Qk,n{x,y-x) , x>0 

Sk.n{x,y)^l , a; < Oandy > (12) 
[ Qn-k+i,n{-y, y-x) , X < and y < . 

Following similar arguments leading to Eqs. ([s]), we 
derive a backward integral equation, for n > 1, 
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In addition, for large fc, 

{dk,n) 



lim 




(7) 



(8) 



Next we show that the result ([8|) is actually universal 
and holds for arbitrary symmetric and continuous jump 
distribution J{x). To make progress for general f{x), we 
came across a very useful combinatorial identity known 
as Pollaczek-Wendcl identity [57] . Using this identity 
and a few manipulations [25], we were able to derive the 
following exact result 



lim {dk 



1 

Trfc 
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dq 



[/(?)]* 



a r(fc+|) 
7^r(fc + i) 



(1 + ^9^)'= 



(9) 



where /(g) = 1°^^^^'^'^ f(j])dri is the Fourier transform 
of the jump distribution. The asymptotic analysis of ([o]) 
gives the universal result [29' 



d(fc)/cr - (27rfc)" 



fc> 1 



(10) 



independent of jij])- This fc 2 dependence of dk (10) 



was actually noticed in the numerical study of periodic 
random walks in Ref. 20] and was also conjectured to 
be exact, based on scaling arguments. 

This result naturally raises the question whether only 
the first moment of the gap is universal, or perhaps the 
universality extends even to the pdf of the gap, once it 
is scaled by the nonuniversal scale factor a. This led 
us next to investigate the full pdf of dk,n- It is conve- 
nient first to consider the joint cumulative distribution 
Sk,n{x,y) = Pr[Mfe^„ > y, Mfc+i_„ < x], with y > x. If 
we can compute this, then the gap pdf Pk,n{dk,n = S) 
can be obtained from the relation 



Pfc.n(<5) 



d^Sk 



ix,y) 



dxdy 



9{y — x)S{x + 6 — y)dxdy . 

(11) 

To compute Sk,n(x,y), as before, it is convenient to 
first define an auxiliary quantity Qk,nix, A) denoting the 
probability that a random walk of n steps, starting from 
xq = x, has fc points in the interval (— c»,— A] (with 
fc > 1) and n — k points on the positive side, hence with 



/>oo 

Qk,n{x,A)^ / Qk.n-i{x',A)f{x-x')dx' 
Jq 



(13) 



+ / Qn-k.n-l{~x',A)f{x ~x' + A)dx' , 



starting from Qofi{x,A) = 1. As before, this integral 
equation can be reduced to a linear differential recurrence 
equation for the special case, f{x) = ^exp(— |x|/6) 
and subsequently solved via the generating function 
method We get 



OQ n - 

5]5]^'=s"Qfe.„(x,A) = — 



n=0 fc=0 



+A z, s. 



V2A 



exp 



(-72(1^^), (14) 



where A{z, s. A) has a complicated expression '29] omit- 



ted here for clarity. From this result and using ( 12 ) and 



(11 1, we find [29] that as n — 00, Pk. 

u{z) - 



fe=i 



8z 



v{z)e 



[u{z) + v{z)e ^t] 



Pk{S) where 
(15) 



with'u(z) = y/l — z+l andu(z) = y/1 — z—1. Extracting 
Pk for all fc from (151 is hard. However, one can easily 



extract the asymptotic behavior for large fc, by analysing 
the z — > 1 limit of (15). This yields, for fc ^ 1 and S 
fixed, Pk{S) ~ k^2F{5) where F{5) decays exponentially 
for large 5 and represents the cut-off function. However, 
before the distribution gets cut-off for large (5, there is a 
scaling regime 5 ^ d{k) ^ a/^/2'Kk, with fc large, where 
we anticipate a scaling form for the gap pdf 



Pk{S) ~ {Vk/a)p(Vk6/<j 



(16) 



and we expect that the scaling function P{x) is indepen- 
dent of fc. Indeed, taking fc — >■ cx) and (5 — > limit in ( 15 ) 
while keeping the scaled variable \fkb j a fixed we find the 
scaling function P{x) satisfies 



\fxP{\fx) dx 



(17) 



This Laplace transform (17) can be inverted to yield fi- 
nally the expression given in Eq. ([l]). 
behaviors of P[x) are given by 



The asymptotic 



P{x) 




(18) 
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which thus exhibits a surprising power law tail. 

The distribution P{x) describes the typical fluctua- 
tions of dfc, which are of order 0{k^^^^) for large k. Hav- 
ing derived it for the special case of exponential jump 
distribution, it is natural to wonder whether the same 
function P{x) appears for other jump distributions as 
well. Remarkably, our numerical simulations show that 
P{x) is indeed universal. In Fig. [3] a) we show a plot of 
the (scaled) pdf of the gaps Pk^n{S)ak^^^^ as a function 
of the scaling variable 5k^^^/a for three different jump 
distributions: exponential, Gaussian and uniform. The 
data shown correspond to a random walks of n = 10'^ and 
fc = 90 and they have been obtained by averaging over 
10® independent trajectories of the random walk. The 
dotted line corresponds to P{x) given in Eq. m. The 
good collapse of these different curves, for Sk^/^/a < 1 
indicate that the typical fluctuations of dk.m of order 
0{k~^^^), are universal - independent of /(ry) - and de- 
scribed by P{x) in Eq. ([T]). 
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FIG. 3. a) : Plot of the pdf of the gaps Pfc,„((5)o-fc"^/^ as 
a function of the scaling variable 6k^^^ /a for three different 
jump distributions. The dotted line corresponds to P{x) given 
Eq. ([T]). The good collapse of the three different curves in- 
dicate that P{x) is universal. Note, in addition, that there 
are no fitting parameters, b) Plot of the moments (d| ^) as 
a function of k (for n — 10^ and three different jump distri- 
butions). The data for p — 4,5 have been shifted downwards 
for clarity. 



In contrast to the typical fluctuations that are de- 
scribed by a universal scaling function, the atypically 
large fluctuations corresponding to 6 ^ d{k) ~ k~^^'^ are 
not universal. This pdf pfe((5) for 6 ^ actually gets 

cut-off in a nonuniversal way, as we have seen before for 
the exponential jump distribution. Thus there are two 
scales of d: a typical fluctuation which is universal and 
large fluctuations that are nonuniversal. This has very 
interesting consequences on the behavior of the moments 
(d^) as a function of k (for large k). One conjectures, 
and this is corroborated by an exact calculation for the 



exponential distribution from Eq. (15), 



\k-' 



D3 (log A:) A:-3/2 ^ 3 
Dpk-y^ , p > 4 , 



where the amplitudes for p < 3 are universal, while the 
amplitudes Dp are not. Our numerical data, shown in 
Fig. [sjb) are in agreement with these results ( 19 ). Indeed 
for p — 1 and p = 2 the value of the scaled moments 
{d^)/aP for different jump distributions do coincide and 
exhibit a power law decay with k in agreement with Eq. 
(19). The solid lines in Fig. Sjindicate the power law 
behavior expected from Eq. (19). On the other hand, 
for p — 4,5, these scaled moments do not coincide and 
they exhibit a power law decay with, seemingly the same 
exponent, although a precise estimate of the exponent 
3/2 for higher moments is quite difficult. 

In conclusion, we have presented exact results for the 
gap statistics of symmetric random walks with a finite 
variance of step lengths and found a rather rich and 
universal behavior independent of the details of the jump 
distribution. This presents an interesting and useful ex- 
ample of solvable order statistics in a correlated time se- 
ries. In view of recent applications of random walks to 
fiuctuating interfaces in 1 -t- 1 dimensions [9HTT| [TT] , it 
will be interesting to see if the universal gap statistics 
found here also holds for different boundary conditions 
of the interface. It would also be interesting to extend 
these results to cases where a is infinite such as in Levy 
flights and also to asymmetric jump distributions. 
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